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VEHICLE LICENCE MONITORING SYSTEM 



TERRITORIAL SURVEILLANCE AND/ OR SECURITY CONTROL SYSTEM 
BASED ON MONITORING VEHICLE LICENSE PLATES 

5 

TECHNICAL FIELD 

The present invention relates to a territorial 
surveillance and/or security control system based on 
monitoring vehicle license plates. 
10 BACKGROUND ART 

Vehicle license plate monitoring is used in a wide 
range of applications, foremost of which include: local 
(e.g. city) traffic speed control; controlling access to 
supervised areas (e.g. parking lots) or restricted 
15 traffic areas (RTA) ; road pricing; and highway security 
control, e.g. monitoring traffic through automatic toll 
systems (telepass) , service areas, etc. 

Vehicle license plates can be monitored using 
either portable devices, e.g. installed in vehicles or 
20 along the edge of the road, or permanent devices, e.g. 
installed overhead on poles close to the road. 

Though greatly improved, territorial security 
control systems based on monitoring vehicle license 
plates still leave room for further improvement. 
25 DISCLOSURE OF INVENTION 

It is an object of the present invention to provide 
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an even further improved territorial surveillance and 
security control system based on monitoring vehicle 
license plates. 

According to the present invention, there is 
5 provided a territorial surveillance and/or security 
control system as claimed in Claim 1. 

BRIEF DESCRIPTION OF THE DRAWINGS 

A preferred, non- limiting embodiment of the 
invention will be described by way of example with 
10 reference to the accompanying drawings, in which: 

Figure 1 shows a block diagram of a territorial 
surveillance and/or security control system in 
accordance with the present invention,- 

Figure 2 shows an architectural diagram of a 
15 license plate reading device forming part of the Figure 
1 system; 

Figure 3 shows a preferred arrangement of a 
binocular sensor device forming part of the Figure 2 
license plate reading device; 
20 Figure 4 shows a preferred pickup configuration of 

the Figure 3 binocular sensor device. 

BEST MODE FOR CARRYING OUT THE INVENTION 

Number 1 in Figure 1 indicates as a whole a 
territorial surveillance and/or security control system 
25 in accordance with the present invention. 

System 1 substantially comprises: 
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a number of mobile surveillance units 
hereinafter referred to simply as Patrols 2 - for 
reading vehicle license plates and generating alarms; 
arid 

5 a permanent remote surveillance centre 

hereinafter referred to simply as Control Centre 3 - 
which communicates by radio with Patrols 2 to locate 
Patrols 2; to update the wanted-plate list; to gather, 
file, and consult the license plates reported by Patrols 

10 2; and to handle Patrol -generated alarms. 

More specifically, each Patrol 2 comprises a car 4 
- in this case, a police car - equipped with an on- 
vehicle navigation system 5; and a license plate reading 
device 6 on car 4 and communicating with on-vehicle 

* 

15 navigation system 5, which controls on-line 
communication with Control Centre 3, displays, on its 
own display, the on-pat rol license plate readings taken 
by Patrol 2, and transmits any alarms (wanted- vehicle 
license plates) . 

20 More specifically, license plate reading device 6 

may, for example, be connected to on-vehicle navigation 
system 5 via an RS 232 serial port, and on-vehicle 
navigation system 5 communicates by radio with Control 
Centre 3 via a GSM/ GPRS module 7, to which it can be 

25 connected via an RS 232 serial port. 

With reference also to Figures 2 and 3, each 
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license plate reading device substantially comprises an 
integrated miniaturized binocular sensor device 8 housed 
in a cylindrical housing 9 (Figure 3) fitted to the roof 
of the Patrol 2 vehicle and so sized as not to affect 
5 the functional characteristics of car 4; and an on- 
vehicle processing unit (ECU) 11 connected to binocular 
sensor device 8 and housed, for example, in the boot 
(not shown) of car 4 . 

Binocular sensor device 8 substantially comprises 
10 two - one right and one left - digital microcameras 12 
for picking up vehicle license plates to the right and 
left of Patrol 2, and each having an optical filter 13 
in the close-to- infrared spectrum, which attenuates 
light, even in full-sun conditions, but provides for 
15 greater stability when taking automatic readings. To 
ensure accurate image pickup and reading in any external 
lighting conditions - which, as is known, vary widely 
and unpredictably from a few lux in the shade, in 
tunnels, and at night, to over 100 Klux with full sun at 
20 the rear - each microcamera is provided with a LED 
lighting device 14, which is pulse-operated with very 
short, programmable exposure times, and is synchronized 
with the acquisition system of relative digital 
microcamera 12 . 

25 The flash emitted by LED lighting device 14 is 

therefore simultaneous with and of the same duration as 
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the exposure time of digital microcamera 12 to ensure 
maximum pickup efficiency; the beam emitted by LED 
lighting device 14 is selected in the close- to -infrared 
range to reduce ambient light interference, and 

5 solutions with 730 and 810 nanometer LED 1 s are possible. 

To ensure license plate reading device 6 operates 
correctly in any external light condition, the operating 
brightness level of each digital microcamera 12, i.e. 
the brightness level at which an image is acquired by 

10 each microcamera 12, is varied cyclically between three 
operating conditions: 

- low light and backlighting; 

- medium (diffused) light; 

- strong light (reflections and rear light) . 

15 Whatever the external lighting conditions, one of 

the above three operating conditions therefore enables 
an image to be picked up from which the license plate 
can be reliably identified. 

As regards orientation of the optical axes of 

20 digital microcameras 12 , in general , various pickup 
configurations can be employed. To select the best, an 
analysis was made of the various license plate angles 
within the viewing frame in the travelling direction of 
Patrol 2, which can be grouped into the following 

25 categories, depending on orientation of the vehicles 
with respect to Patrol 2: 
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a) vehicles travelling in the same direction, in 
both right and left (overtaking) lanes; this situation 
is typical of main city streets, main roads, ring- roads 
and motorways, and is limited to lanes adjacent to the 

5 patrol vehicle; 

b) on-coming vehicles in the opposite left-hand 
lane; this situation is typical of narrow two-way city 
streets (in historic centres) ; 

c) parked vehicles facing iii the travelling 
10 direction at the side of the road, normally on the 

right, but also on the left in the case of narrow, one- 
way roads; this situation is typical of all urban areas 
(main streets, side lanes, narrow streets in historic 
centres, etc. ) ; 

15 d) parked vehicles "jack-knifed" on the right and 

left, depending on the type of road (one- or two-way) ; 
this situation is typical of certain city streets to 
make the best use of available parking space, and is 
common in large parking areas : factories, airports, 

20 etc.; vehicle angles vary widely : at times, vehicles 
may be angled only slightly with respect to the 
travelling direction of the patrol vehicle (airport 
parking areas) , and at others may be angled sharply (as 
in crowded "unauthorized" city parking areas) ; 

25 e) any other possible configurations not falling 

within the above categories, such as randomly parked 
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vehicles (even perpendicular to the travelling direction 
of the patrol vehicle) or vehicles parked on rough 
ground (dirt parking areas) . 

From analysis at the test stage, a probability 
5 estimate was made of the above vehicle orientation 
conditions and used as a preliminary basis in selecting 
the pickup configuration of the license plate reading 
device. More specifically, the pickup configuration in 
Figure 4 was selected, which represents a compromise 
10 statistically ensuring the maximum number of license 
plate readings at each patrol. 

More specifically, in the selected pickup 
configuration, the optical axis of each digital 
microcamera 12 is located to cover a roughly three -metre 
15 lateral area of the vehicle, the focal plane of digital 
microcamera 12 is located roughly six metres in front of 
Patrol 2, and the field depth of digital microcamera 12 
is roughly four metres. 

With reference to Figure 2, the on-vehicle 
20 processing unit 11 of license plate, reading device 6 
comprises two image acquisition and processing devices 
(Smart Readers) 15, each connected to a respective 
digital microcamera 12 to acquire the images picked up 
by digital microcamera 12 and extract character strings 
25 from the license plate readings; two lighting control 
devices 16, each connected to a respective LED lighting 
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device 14 to time and synchronize light emission by LED 
lighting device 14 as described previously; a data 
storage device (Hard Disk) 17 for storing reading data, 
comprising images, license plate reading character 

5 strings, date and time, and reading georeference data 
from the satellite navigation system; a communication 
device (wireless LAN bridge) 18 for transmitting license 
plate readings to the Control Centre over a wireless LAN 
communication network ^nd a corresponding communication 

10 device (not shown) at the Control Centre; and an 
Ethernet LAN network 19 connecting the various parts of 
on- vehicle processing unit U. 

Each license plate reading device 6 may comprise an 
optional third colour microcamera 20 (for this reason, 

15 shown by the dash line) installed in the passenger 
compartment of the vehicle, preferably on the rear- view 
mirror, and connected to data storage device 17 (or to 
an optional videorecorder in the boot of the vehicle) to 
videorecord particular scenes ahead of the vehicle; and 

20 a personal computer 21 connectable to Ethernet LAN 
network 19 for special functions. 

On-vehicle processing unit 11 performs the 
following operations: 

- continuously reads the two digital video channels 

25 from digital microcameras 12 to identify all the 
readable license plates 4 in the frame at a processing 
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rate of over 15 consecutive readings per second; 

time- integrates readings to distinguish in- 
transit vehicles and avoid repeatedly indicating the 
same license plate; 

5 - compares recognized license plates with a wanted- 

plate list loaded by the Control Centre at the start of 
patrol and possibly updated during patrol by 
communication over GSM/GPRS; 

- controls dialoging with on-vehicle navigation 

10 system 5 to transmit any alarms and receive georef erence 
data relative to Patrol 2. 

Performing the aboVe functions over two independent 
channels (right and left microcameras) calls for 
considerable processing capacity combined with low 

15 consumption levels - much lower than standard industrial 
equipment - to avoid running down the batteries of 
Patrol 2 . 

For this reason, advanced INTEL X-Scale "embedded" 
technology is used, which, employing an INTEL X-Scale 

20 Integer Processor (880 MHz, 32 bits, 64 MB RAM), 
provides for license plate reading at video frequency, 
over 15 license plate readings per second, even in 
complex, continually varying frames; lOO Mbit/s network 
connection; easy remote connections for maintenance and 

25 updating; low consumption; 12-24 v supply; and 
exceptional compactness . 
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On- vehicle processing unit 11, in fact, is 
tantamount to a network server, in which, communication 
with Control Centre 3 is conducted over the Wireless-LAN 
connection and open to developments in 
5 telecommunications technology. 

With reference t;o Figure 1, Control Centre 3 
substantially comprises two sections or stations 
logically, though not necessarily, physically separate 
and communicating over a LAN network; a patrol radio- 
10 location station 22 for locating by radio and 
communicating with Patrols 2 via a GSM/GPRS module 23; 
and a license plate control station 24 for updating the 
wanted-plate list, for gathering, filing and consulting 
the license plates picked up by Patrols 2, and for 
15 handling Patrol -generated alarms, 

A database of license plates gathered and memorized 
during previous patrols can be consulted at any time by 
Control Centre 3 personnel for various purposes: 

- to look up a license plate on the basis of a 
20 complete string or partial data, to determine where and 
when it was reported; the resident program at the 
license plate control station employs a map system to 
enable the operator to* graphically locate the area in 
which a license plate was reported by simply selecting 
25 the desired in- transit vehicle. License plate control 
station 24 also provides for displaying an image of the 
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vehicle corresponding to the identified plate, and for 
indicating the pickup site on the map, complete with 
image zooming and enhancement; 

- to review alarm images to check they are correct 
5 and determine, if possible, the type of vehicle 

reported; 

- to update the wanted-plate list by adding or 
deleting strings /plates, and possibly entering comments 
on the type of alarm .(stolen car, under investigation, 

10 etc.) . 

Consultation of the database is restricted by 
password to authorized personnel only. 

Operation of the territorial surveillance and 
security control system according to the present 
15 invention will now be described with particular 
reference to user operation. 

1. Loading data and wanted-plate lists 

Thi s is done at Control Centre 3 by a proces sing 
station (PC) equipped with software and a user interface 

20 for updating and consulting the license plate database. 
Data exchange between Control Centre 3 and Patrols 2 is 
over a wireless LAN connection - shown schematically in 
Figure 1 by 25 - in an appropriate exchange area, e.g. 
inside a police garage or workshop, to minimize labour 

25 and make data exchange as automatic as possible. 

2 . Patrol start-up 4 



WO 2004/027730 



PCT/IT2003/000558 



- 12 - 

Starting up car 4 calls for no additional work on 
the part of patrol personnel, all data being updated 
fully automatically over wireless LAN connection 25. 
Once the updated wanted-plate data is received from 
5 Control Centre 3, the system is ready and patrolling can 
commence . 

When turned on, license plate reading device 6 
communicates its status to on-vehicle navigation system 
5, which displays it on its own on-vehicle display by 
10 means of an appropriate icon (e.g. a green traffic- 
light) . 

License plate reading device 6 and on-vehicle 
navigation system 5 continually check correct operation 
and indicate any malfunctions. 
15 From this point on, license-plate reading device 6 

reads and memorizes any license plates encountered en- 
route . 

3 . On-patrol license plate reading 

On patrol, the user transmits and receives messages 
20 to and from Control Centre 3 over on-vehicle navigation 
system 5. In addition to the standard services provided 
by on-vehicle navigation system 5 , the following are 
also available: 

- license plate reading device 6 memorizes data 
25 relative to vehicles travelling in the right and left 
lanes with respect to the travelling direction of the 
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patrol vehicle. The string corresponding to the last 
license plate reading from each digital microcamera 12 
is updated continually on the on-vehicle navigation 
system 5 display, and appears on the right or left of 

5 the display, depending on which digital microcamera 12 
it refers to, so as to enable the operator to check 
operation of license plate reading device 6; 

in-transit data is recorded by license plate 
reading device 6, and contains the detected license 

10 plate string, the image (compressed or not) of the in- 
transit vehicle, and the date, time and location 
(georef erenced data from the on-vehicle navigation 
system) ; 

- when a wanted plate is detected, license plate 

t 

15 reading device 6 displays it on the on-vehicle 
navigation system di splay ; 

- an alarm signal is transmitted automatically in 
real time to control Centre 3 by on-vehicle navigation 
system 5 over GSM/ GPRS module 7; in the event of failure 

20 to transmit the alarm signal to Control Centre 3 , on- 
vehicle navigation system 5 displays a fail message; and 
a marker is automatically shown on the on-vehicle 
navigation system 5 display map to indicate the pickup 
location of the license plate in question; 

25 - via GSM/GPRS module 23, Control Centre 3 can also 

supply on-vehicle navigation system 5 with additional 
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plates to check or to add to the existing on-vehicle 
list, even while on patrol; these new data strings are 
entered by a resident program, at license plate control 
station 24, connected .to the radio-location system and 
5 designed to transmit data to all the mobile surveillance 
units; on receiving a message from Control Centre 3 
containing a new plate to check, on-vehicle navigation 
system 5 transmits the relative string to on-vehicle 
processing unit 11, which enters the plate on the check 
10 plate list. 

4. Re-entry 

Upon re-entry of Patrol 2, license plate reading 
device 6 provides automatically for transferring all the 
data picked up on patrol by Patrol 2 (e.g. license plate 
15 reading list, digital images, alarm list, etc.) to 
Control Centre 3 over wireless LAN connection 25, for 
shutting down the system, and for cutting off its own 
power supply. 

Field tests conducted by the Applicant to compare 
20 the number of license plate readings by Patrol 2 
equipped with license plate reading device 6, with the 
number of supposedly "readable" plates counted 
personally by a patrol member seated next to the driver 
(concealed-vehicle plates outside the frame of the 
25 microcameras were not counted as "readable") , showed the 
system to have a reading percentage of over 80%. The 
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reduction in performance between night-time and daytime 
readings is negligible and less than 5%. Night-time 
images , in fact, are only inadequate in the case of very 
dirty or deteriorated plates. Otherwise, the infrared 

5 LED's provide for even better images than in daytime, by 
greatly attenuating any objects in the frame which, 
unlike license plates, are not retroref lective. No 
noticeable reduction in performance was recorded in 
rainy or overcast weather conditions, which in fact even 

10 make for more uniform images, comparable to twilight or 
night-time readings. 

Clearly, changes may be made to the system as 
described and illustrated herein without, however, 
departing from the scope of the present invention as 

15 defined in the accompanying Claims. 

In particular, the system may be used for 
applications other than the one (security) described, 
i.e. detecting data relative to (stationary/moving) 
vehicle license plates for security reasons, or for 

20 locating, by generating automatic alarms, "suspect" 
vehicles, e.g. stolen or owned/used by individuals 
sought after, under investigation, or wanted, etc. by 
the police. 

The (surveillance) system can also be used locally 
25 to control authorized vehicles in limited-traffic areas 
(LTA) , e.g. in historic town centres. In which case, 
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alarms may be generated upon automatically detecting 

i 

license plate numbers not listed as being authorized to 
circulate in such areas. 



